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Abstract 

' We consider the frame property of the Gabor system Q(g,a,/3) = 

: m,n £ Z} for the case of rational oversampling, 
(3JT)' i.e. a, j3 € Q. A 'rational' analogue of the Ron-Shen Gramian is con- 

3 , structed, and prove that for any odd window function g the system 

■ Q(g,a,(3) does not generate a frame if a/3 = 1L -^- Special attention is 

■ paid to the first Hermite function = ie _7r * 2 . 
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1 Introduction 

> \ 

One of the fundamental problems of Gabor analysis can be stated as follows: 
given a window function g E L 2 (]R), determine the set of lattice parame- 

■ ters a, /3>0 such that the Gabor system G(g,a,(3)={e 2l ' Kl3nt g(t— am):m,n^Z} 
qq ! forms a frame in L 2 (M). 

F(g) ■= {(a,/3) € R 2 + : G(g,a,P) is a frame for IS 

We remind some known facts about the frame set J~(g), following [3] 
and (in more compressed form) [6]. Under milder conditions, precisely if g 
rN \ is in the Feichtinger algebra M 1 the set J-{g) is open in M. 2 ^ and contains 

C3 ' a neighborhood of the origin. Fundamental density theorems [3l HI [7] to- 

gether with a version of the uncertainty principle [TJ [2] asserts that also 
F(g) C n+ := {(a,P) € : a/3 < 1} for 5 G M 1 . 

Up to the very recent time just few functions have been known for which 
T = n+. The list included the Gaussian g(t) = e" 71 "* 2 HU 13 E] , the hyper- 
bolic secant g(t) = (e* + e" 4 ) -1 , one- and two-sided exponential functions 
g(t) = e _4 lR + (in this case a/3 = 1 also generates a frame) and g(t) = e £ ' 
[EJ [10], as well as their shifts, dilates, and Fourier transforms. A break- 
through was achieved in [6] where the authors constructed an infinite family 
of functions for which J~(g) = II + by proving that any totally positive func- 
tion of finite type possesses this property. 



1 



2 



On the other hand it is shown in [9J that the set J-{g) may have rather 
complicated structure even for the "simple" function such as the character- 
istic function g = lj of an interval. 

In this article we attempt to study the set J-(g) for some cases when 
J-{g) 7^ n + and g is well concentrated both in time and frequency. Our 
primary objective is the first Hermite function h\(t) = ie _7r * 2 . This choice is 
motivated by the uncertainty principle (h\ minimizes the Heisenberg uncer- 
tainty among all functions which are orthogonal to the Gaussian) and also 
recent results regarding vector- valued Gabor frames [5]. 

The article is organized as follows. The next section contains nota- 
tion and basic facts from Gabor analysis which will be used in the sequel. 
The whole analysis is carried out for the case of rational oversampling: 
a/3 = p/q G Q. In Section [3] we prove that for any odd function g G M 1 
(in particular h\ of course) the set J-{g) does NOT contain the union of 
hyperbolas: 

77 — 1 

a(3 = ——^(a,p)^T(g),n = 2,3,.... (1) 

The proof is based on analysis of the vector- valued Zak transform (see [16] 
and also [U ch. 8]) which represents the frame operator as matrix multipli- 
cation in a space of vector-valued functions. In the next section we factorize 
the matrix of the vector-valued Zak transform and extract a factor which is 
a rational analogue of the well-known Ron-Shen Gramian (see [12] and also 
[1]). In Section [5] we conjecture that condition ([1]) is the only restriction on 
the set F{h\): 

TL — 1 

JF(h x ) = {(a, /3) G IT_|_ : a/3 ^ , n = 2, 3, . . . }. 

71 

Unfortunately we are not able to prove this conjecture in its full range. We 
prove it analytically just for some points in H+ and also provide numerical 
verification for a wider set of points. These constructions are based on the 
rational analogue of the Gramian given in Section [H 

The authors thank E.Malinnikova for useful discussions and hints. 

2 Preliminaries 

In this section we remind the basic facts from Gabor analysis which will be 
used later. We refer the reader to [3] for a more detailed presentation as 
well as the history of the subject. 
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Given numbers a, (3 > and a window function g we consider the lattice 
A = olL x /3Z and the Gabor system 

G(g,a,/3) = {7T X g : A G A}, 

where tt\ : g — > e 2nlbt g(t — a) for A = (a, b) denotes the usual time- frequency 
shift. The Gabor frame operator 5 9i a : L 2 (W) — > L 2 (M) is defined as 

S gA f(t)= ^(/,vr A <7} L2(R) 7r A <7(t), feL 2 (R). 
Ae A 

If g belongs to the modulation space M 1 (M) (we remind the definition later 
in this section) this operator is bounded, and Q(g, A) is a Gabor frame if and 
only if the Gabor frame operator is invertible. In this article we consider 
the case a[3 £ Q. The operator S 9t \ can in this case be realized as a 
multiplication-operator in a space of vector-valued functions. 

Let a/3 = p/q for some relatively primes p, q 6 N. Consider the rectangle 
Qa,/3 = [0, ol/p) x [0, 1/a) and the space of vector- valued functions % atP = 

L 2 (Q atP ,C p )- 

We remind that the Zak transform is defined as 

Z a f(t,u J ) = Y,f(t-nn)e 2 ™ a ". (2) 

Following [H ch. 8] we consider the vector-valued Zak transform : L 2 (R) — s> 
H a ,p defined as 

~Z a f(x,u) = (Z a (x + -r,uj))l =v (x,u) e Qa tP 

The vector- valued Zak transform is up to normalization a unitary mapping 
between L 2 (R) and Ji ayV - 
Denote also 

s-i 

A s r { Xl u) = aTz a g(x + -s,u>- Pj)Z a g(x + -r,u- f$ 3 )e 2m ^l\ 
U P P 

and consider the p x p matrix function 

A(x,u) = (A*(x,U)))P~ =0 , (x,u) G Q ajP . 

Theorem A( Zibulskii-Zeevi) (see [16] and also Theorem 8.3.3. in [4]). 

With the above assumptions we have 

~Z a (Sg :a! j3f)(x,uj) = A(x,oj)Z a f(x,uj), 
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for almost all (x,u) £ Q a ,p- 

In what follows we assume that g belongs to the modulation space M 1 (M). 

Definition 1. The modulation space M 1 (M) consists functions g for which 
the norm 

IIpIImi(R) = / / \ v f9(x,uj)\ dx dw < oo 

for some (or equivalently all) non-trivial function f in the Schwartz space 
S(R). 

If g £ M 1 (M) then Z a g is continuous. 

Corollary 1. The Gabor system Q(g,A) is a frame in L 2 (R) if and only if 
detA(x,uj) 7^ 0, € Qa :P . (3) 

We factorizes the matrix A in order to make condition ([3]) more trans- 
parent. Consider the column vectors 

Xi(x,uj) = (Xi(x,u>)) P r Zl, J = 0, 1, • • • ,q-l 

where 

X}{x,w) = Z a g(t + /3j)e 2 ^, (4) 
P 



and the p x q matrix 



Q{t, U ) = {X^ q -_l = (z a g{t + Pj)e 2 ^/A P ~ 1,9 ~ J . 

J ~ u V p / r =0,j=0 



Let Q T denote the conjugate transform of Q. Clearly 

A{x,oj) = Q(x,lo)Q t (x,uj). 

We have 

9-1 

A(x,uS)Z a f{x,uj) = y^ y (X j (x,lj), 

a. 

f(x,u))(X : '(x,uj), 

a 

so the condition ([3]) is met if and only if for each (x,ui) € Q a ,p the vectors 
Xi{x,u), j = 0, 1, . . . q — 1 span C p . 

Corollary 2. Let a(3 = | 6 Q and g G M 1 (R). If G(g,A) is a frame in 
L 2 (K) i£ is necessary and sufficient that 

rankQ(x,uj) = p, for all (x,u) 6 

In the next section we use this condition in order to study Gabor systems 
generated by odd functions. 
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3 Gabor frames generated by odd functions 

In this section we prove the following 

Theorem 1. Let g G M l (M) be an odd function andaf3 = n = 2, 3, ... . 
Then G(g, A) cannot form a frame in L 2 (R). 

Proof. We will prove that 

rankQ(0,0) < n- 1. (5) 

The results then follows from Corollary [2J 

Relation ([5]) will follow from the fact that for odd windows the elements 
of the matrix Q(0, 0) posses additional symmetries. For simplicity we will 
assume a = 1. 

Lemma 1. Let g € M 1 (M) be an odd function, and let a = 1, /3 = p/q € Q 
and Xi = Xi(0,0), where the functions Xs(x,u) are defined by (jj]). Then 

Xi = -X q p Zi, s = 0, 1,... ,p- 1, j = 0,1, .. . ,q- 1. (6) 

The proof of the lemma follows readily from the definition of the Zak 
transform and also from the fact that g is odd. We will use this lemma for 
q-p=l. 

First we consider the case q = 2k + 2, p = 2k + 1 [q is an even number). 
In this case Q(0, 0) is a (2k + 1) x (2k + 2) matrix. 

We need additional relations for the elements of the zero row, the zero 
column and also the (k + l)-th column of Q(0, 0). Namely 

X® = 0, X* +l = 0, X J Q = -X$~ j - zero row (7) 
Xg = — Xp_ s , s = 1, . . . ,p — 1 - zero column; (8) 
X k s +1 = -X*±}, s = 1, . . . p - 1 (k + l)th column. (9) 

As in Lemma Q] these relations follow readily from the definition of the Zak 
transform. 

Let R s denote the s-th row of Q(0,0). Consider the row vectors e/ = 
(e' l )j=0,i,...2k+2, I = 1,2,... , k, where e\ = 0, for j ^ I + 1, 2k + 2 - I, 
e\ +1 = 1, and ef +2 ~ l = -1. 

From the relations ([!]), ([7]), ([8]), and ([9|) it is easy to see that all rows of 
Q belong to S = span {{i?^ =1 } U {ejf =0 }. 

Indeed the row Rq has the form 

R= (0,ai,... a k ,0, -a k ,..., -qi) (10) 
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for some a±, . . . , at, thus the vector can be spanned by {e;}JL . The rows 
R s s = 1, . . . , k belong to the spanning set themselves. So it suffices to 
prove that the rows R p - S , s = 1, . . . k also belong to S or equivalently the 
vectors R s + R P - S belong to S. The later is evident since, according (|6j) and 
([8]), these vectors also have the form (fT0|) . 

This completes the proof of the Theorem in the case q = 2k + 2, p = 
2k + 1. 

Consider now the case p = 2k, q = 2k + 1 (q is an odd number). Once 
again, in addition to the general relation ©, we need relations for selected 
rows and columns: 

Xq~ 3 , - zero row; 
-Xp_ s - zero column; 
-X^T 1 - fc-th row. 

Consider now the rows e; = (e^) J= o,i...2fc 5 I = 1,2,... k with ej = if 
j ^ 1, 2k - I + 1, 4 = 1, and e^ _/+1 = -1. 

Applying the same arguments as in the previous case we can see that 
the set of 2k — 1 vectors {-fi^l^i,. .. U {e/}/^... ^ spans all rows of the 
matrix Q(0,0). 

This completes the proof of Theorem [TJ □ 



x J = - 
x° s =- 

K = - 



4 Factorization of the Zibulskii-Zeevi matrix 

In this section we study the Zibulskii-Zeevi matrix Q(x,co). Our goal is to 
reduce it to a simpler p x q matrix having the same rank as Q. One can 
consider this simpler matrix as an analogue of the Ron-Shen Gramian [12] 
for rationally oversampled Gabor systems. 

We believe this reduction is interesting by itself, it will be also used in the 
next section in order to study Gabor frames generated by the first Hermite 
function. 

Theorem 2. Let the window function g belong to Af 1 (M) and aft = - € Q. 
The system G(g, a, (3) forms a frame in L 2 (R) if and only if the matrix 

( a Y' 1 q ^ 

V{x,uj) = ( Z aq g(x + -(tp + sq),u>) ) (11) 

has rank = p for all (x, u) € Q a ,p ■ 
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Proof. Fix (x,co) G Q a ,p an d let 

Xi = Z a g(x+- S ,LO~Pj)e 2 ™f = V 5 (x+-(.s-pn)) e 2 ™ e 2 "^f (12) 

n 

be the corresponding element of the matrix Q(x,u). 
For each s = 0, 1, . . . ,p — 1, t = 0, 1, . . . , g — 1 let 

L(s) := {Z : I = s — pn, n G Z}, L(s, t) = {Z G L(s) : I = t + mg, m G Z}. 

Setting Z = s — pn in (|12|) we obtain 



«6L(s) ^ 

9-1 

e p > #(x H — l)e pe «. (13) 

t=o ie£(s,t) P 

For each t G {0, . . . q — 1} and s G {0, . . . ,p — 1} we chose numbers A; t G 
{0, . . . g — 1} and m s G {0, . . . ,p — 1} such that 

hp = i(mod q), m s q = s(mod p). 

One can easily see that L(s,t) = {ktp + m s q — pqm : m G Z}, so one can 
rewrite ([TBI as 



9-1 



e e ix 

t=o 



J2g(x+ ^(ktp + m s q) - maqj e 2 -™ . (14) 



=Z aq g{x+j(ktp+rn a q),ui) 

Since the numbers kt runs through the set {0, ... q — 1} as t runs through 
this set, we can rewrite (|14|) as 

3-1 



T = 

^ g (x + ^{rp + m s q) - maq^j e 2i ™ maq 



m.gZ 



~-Z aq g (x+ j {rp+m s q),u) 
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or 

Q(x,oo) = dms{e 2 ^^} p s Z l P(x,u) diagje 2 ™}^ W, 

here 

P(x,u) = (z aq g(x + -(rp + m a q),u)Y " , W = (e 2i7rrJ 'f . 

V P / s =0r=0 V Jr >i=° 

Clearly the matrices V(x,u) and Q(x,u) have the same rank. On the other 
hand, since the number m s runs through the whole set {0, 1, . . . ,p — 1} 
as s runs through this set the matrices V(x,ui) and V(x,cj) differ only by 
permutations of their rows and hence have the same rank. □ 



5 Example 

In [5] it is proved that the Gabor system Q(h\,a, j3) is a frame if a/3 < h, and 
fails to be a frame if a/3 = ^. Furthermore the authors discuss an example 
suggesting that this result may be sharp. 

In this section we prove that for at least some a, (3 with a/3 > \ the 
system Q(hi,a, j3) indeed generates a frame in L 2 (]R). The proof uses the 
matrix-function V constructed in the previous section, and also a result on 
diagonally- dominant matrices. 

Theorem 3. Let a (3 = 3/5 and hi(t) = te~ nt2 . Then the system Q(h±,a, (3) 
is a frame in L 2 (R) . 



Proof. The matrix V(x,uj) takes the form 



5a n 2 ' 4 



Vi(x,uj) = Z 5a hi(x + at + s— ,lo) 



3 / s ,t=o 

By Theorem [2] and Corollary [5] it suffices to prove that 

rank "Pi (x, uj) = 3, for all (x,ui) € Q a ,3- 
We split the proof into several steps. 

a. It suffices to prove that Q{h\, a, j3), a/3 = | is a frame for a > y^f • The 
case (3 > y| can be reduced to the previous by using the Fourier transform. 

b. Since the function h\ decays fast one can approximate Z^ a h\{x,uj) 
with the maximal term of the series. In particular the following holds 
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Lemma 2. Let < \x\ < ^. Then 

\hi(x) - Z 5a h 1 (x,uj)\ < C 5a hi(5a - \x\) 

where C 5a = 2 + £ n > 2 hi(5an) + hi( 5a{2 ™ ~ 1} )■ 

This lemma can be verified directly. For all practical reasons we can 
assume that C^ a = 0. 

c. We will see later in (g) that it suffices to consider < x < ^. This 
will follow from symmetry of hi and quasi-periodicity of the Zak transform. 
We split the interval < x < ^ in two: < x < and yrj < x < ^. 

d. Let < x < j^. Consider the sub-matrix of Vi(x,u) corresponding 
to t = 1,2,3. After interchanging of the second and third row this matrix 
takes the form 

(Z 5a hi(x + a,uS) Z 5a hi(x + 2a, u) Z 5a hi(x + 3a, oj) \ 
Z 5a h 1 (x + ^,u) ZMx + ^f^) Z 5a h 1 {x + ^,u)\. 
ZMx + f^) ZMx + lf^) Z 5a h 1 (x + ^,oj)J 

We will use the following theorem about diagonally dominant matrices. 

Theorem B (see [E]). If (af) is an n x n-matrix with complex elements 
such that either 

W : > Y.k,wK\i l<i<n 

or 

(ii): |ail|aj| > (Efc,fc^l a fcl)(Sfc,fc^l a il)' 1 < *,J < «, 
then det(ajfc) ^ 0. 

e. We will check that Theorem B can be used to prove invertibility of the 
matrix in (d). We emphasis the main steps of the proof. 

• Using the fact that \Z^ a h\{x,uj)\ is 5a-periodic function one can rep- 
resent the absolute values of the elements of the matrix in (e) as 

(\Z 5a hi(x + a,u>)\ \Z 5a hi(x + 2a,u>)\ \Z 5a hi(x — 2a, 
\Z 5a hi(x - j^,u>)\ \Z^ a h\(x+^,uj)\ \Z 5a hi(x+^,u)\\ . 
\Z 5a hi(x - &,u))\ \Z 5a hi(x - -f,u})\ \Z 5a hi(x - § J 
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• Using Lemma [2] one can replace all elements, except those with indices 
(1, 2), (1, 3) and (3, 1) with the main term of the corresponding series. 
We use an upper bound for the remaining (non-diagonal) elements 
replacing Z^ a h\{x — -y^w) and Z^ a h\{x ± 2a, uj) with respectively 
2>h\(x — and 3/ii(x ± 2a). Namely, for x near Lemma [2] gives 

\Z^ a hi(x, uj)\ = \hi(x)—Z^ a hi(x, bj)—hi{x)\<hi{x)+C^ a hiiha—\x\). 

Since the constant C$ a ?» 2 we use the estimate \Z^ a h\{x, ui)\ < 3h±(x) 
for x near Since we plan to use Theorem B we use an upper 
estimate for the non-diagonal elements. For the other values of x the 
error is negliable. 

We will show that the following matrix satisfies the conditions of 
Theorem B. 

3 / \hi(x + a)\ ?>\h 1 (x + 2a)\ Z\h 1 (x-2a)\\ 

(h() = Mz-f)\ \h x {x + %)\ Mx + f)] . 

\3\hi(x-f)\ Mx-f)\ \h x {x-%)\) 

• For < x < ^ and y| < a < 1 condition (ii) in Theorem B can now 
be verified by direct inspection. 

• For < x < ^ and a > 1 we consider the difference 

Hl-Y^Hl 1<*<3. 

k,k^i 

If this expression is positive then condition (i) in Theorem B is met. 
Consider first the case i = 1. Then we need to verify 

H\ - H\ - Hf > 0. (15) 

Let ay = x for < y < ^ . Then (fT5j) is equivalent to 

/ii(a(y + 1)) - 3h!(a(y + 2)) - 3/n(a(2 - y)) 

> /ii(a(^ + 1)) - 3/n(2a) - 3/n(a(2 - -L)) 

, ,13a, , ,23a, , ,13a./ 23 sttc 2 \ 

> M - 6/ti( = M ) 1 - 6— e — 2- 

u 12 ' v 12 ' u 12 ; V 13 / 

which clearly is positive for all values a > 1. The proof of the cases 
i = 2 and i = 3 follows along the same lines. 
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f. The case 1/12 < x < 1/6 and a > y | can be treated similarly to 
the previous case. In this case one can verify that the submatrix of T'i(x,uj) 
corresponding to the columns t = 0, 2, 3 fulfill condition (i) of Theorem B. 

g. We prove that the case ^ < x < ^ can be reduced to the previous 
ones. By substituting x = ^ — y we have 

■ T ,a 5a . , ,a , lN 5 5a .. 

\2 5a hi{- - y + at + r—,u))\ = \Z 5a hi{- - y + at + a[r - 1)- + — , u)\ 

5 

= \Zs a hi{y - a(t + 2) - a(r - 

It is clear that the two cases are - up to permutations of rows/columns - 
similar for < x < ^ and ^ < x < ^. □ 



6 Conjecture 

Calculations of the previous section become too cumbersome for arbitrary 
a,f3 with aj3 € Q, afi < 1. Numerous numerical calculations make us to 
believe that the following statement is true: 

Conjecture Let af3 < 1 and a/3 ^ [n — l)/n, n = 1,2,...,. Then 
Q(h\,a, /3) in a frame in L 2 (R). 

Unfortunately the authors are at the moment not able to prove/disprove 
this statement even in the case a/3 G Q. 

The following figure suggest that a/3 = J1= ^- are the only exceptional 
cases. Figure [1] shows the minimal eigenvalue of V(x, ui)V T {x, to) for < 
x < ^ and < uj < £ for a/3 = ^ for 5 < n < 201 and 1 < j < n - 1. 
With this choice of n and j we have a/3 < 0.995. In the experiments we 
have considered a = 1. 
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fa) 




Figure 1: Minimal eigenvalue of VV T for (a) a/3 < 0.98 and (b) 0.98 < 
a/3 < 0.995. In the experiments we have used a = 1. Note that the scaling 
of the y-axis differs. 
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